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FOOTNOTES 

1  Knight,  F.  H. ,  Risk,  Uncertainty  and  Profit,  Houghton  Mifflin  Co., 
Boston,  1921.  But  see  Arrow's  conments:  "in  brief,  Khight's  uncertain¬ 
ties  3een  to  have  surprisingly  many  of  the  properties  of  ordinary 

*> 

probabilities,  and  it  is  not  clear  how  much  is  gained  by  the  distinction 
. . .  .Actually,  his  uncertainties  produce  about  the  same  reactions  in 
individuals  as  other  writers  ascribe  to  risks."  Arrow,  K.  J., 

"Alternative  Approaches  to  the  Theory  of  Choice  in  Risk -taking  Situation," 
Econonetrlca,  Vol.  19,  October  1951/  PP*  **17,-  ^6. 

Shackle,  G.  L.  S.,  Uncertainty  in  Economics  (Cambridge  1955)/ 
p.  3.  if  tills  example  were  not  typical  of  a  number  of  Shackle's  work, 
it  would  see::,  almost  unfair  to  cite  it,  since  it  appears  so  transparently 
inconsistent  with  commonly -observed  behavior.  Can  Shackle  really  believe 
tiiat  ar.  Australian  captain  who  cared  about  batting  first  would  be 
indifferent  between  staking  this  outcome  on  "heads"  or  on  an  ace? 

^  Ramsey,  F.  P.,  "Truth  and  Probebility"  (1926)  in  The  Foundations 
of  Mathematics  and  Other  Logical  Essays,  London,  1931;  Savage,  L.  J., 

The  Foundations  of  Statistics,  New  York,  1951;  de  Finettl,  E.,  "Recent 
J-ggestio ns  for  the  Reconciliation  of  Theories  of  Probability,  "  PP-  217- 
f  /  01’  Proceeding:,  of  the  3econd  (1990)  Berkeley  ^posium  on  Mathematical 
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Statistics  gad  Probability.  Berkeley,  1951;  Suppes,  P.  (see  Sijppes,  P. , 
Davidson,  D.,  and.  Siegel,  8.,  Peel  slop  Making,  Ttanfbrd,  1957)  •  Closely 
RBJfcted  approaches,  In  which  individual  choice  behavior  is  presumed  to  be 
stochastic,  have  been  developed  by  Luee,  R.  D. ,  Individual  Choice  Behavior, 
lev  York,  1959*  sod  Chipoan,  J.  8.,  "Stochastic  Choice  and  Subjective 
Probability, "  In  Decisions,  Values  and  Groups,  ed.  Wlllner,  D. ,  lev  York, 
I960.  Although  the  argument  In  this  paper  applies  equally  veil  to  these 

latter  stochastic  sxlom  tystama,  they  will  not  be  discussed  explicitly. 

a 

Rsaeey,  ,  p  •  171* 

**  0!P«  clt.,  p.  21.  Savage  notes  that  the  principle,  in  the  form  ~>f 
the  rationale  above,  "cannot  appropriately  be  accepted  as  a  postulate  in 
the  sense  that  PI  is,  because  It  would  Introduce  nev  undefined  technical 
terms  referring  to  knowledge  and  possibility  that  would  render  it  mathe¬ 
matical ly  useless  without  still  mors  postulates  governing  these  terr.s." 

Ba  substitutes  for  It  a  postulate  corresponding  to  P2  above  as  expressing 
the  same  Intuitive  constraint,  asvags's  PE  corresponds  closely  to 
"Rubin's  Postulate"  (Duos  and  Ralfffc,  Pages  and  Decisions,  Nev  York,  1957, 
p.  290)  or  Minor's  "Column  Linearity"  postulate.  Ibid. .  p.  297,  which 
lxply  that  adding  a  constant  to  a  column  of  payoffs  should  not  change  the 
preference  ordering  aaang  acts. 

If  numerical  probabilities  were  assumed  known,  so  that  the  subject 
were  dealing  explicitly  vlth  known  "risks,"  these  postulates  would  amount 
to  Samuel  son' a  "Special  Independence  Assumption"  ("Probability,  Utility, 
and  the  Independence  Axiom,"  Sconopetrica,  20,  670-78,  1952)  on  which 
Saauelson  relies  heavily  in  his  derivation  of  "von  Neumann-Morgenstem 
ullltles." 


ill 


6  I  bet. 
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'  Note  that  In  no  case  are  you  Invited  to  choose  both  a  color  and  an 
urn  freely;  nor  are  you  given  any  Indication  beforehand  aa  to  the  full  set 
of  gambles  that  will  be  offered.  If  these  conditions  vere  altered  (as  In 
3ome  of  H.  Raiff&'s  experiments  with  students),  you  could  enploy  randomized 
strategies,  such  as  flipping  a  coin  to  determine  what  color  to  bet  on  In 
Urn  I,  which  might  affect  your  choices. 

O 

Bare  vs  see  the  advantages  of  purely  hypothetical  experiments.  In 
"real  life,"  you  would  probably  tun  out  to  have  a  profound  color  prefer¬ 
ence  that  would  Invalidate  the  whole  first  set  of  trials,  and  various 
other  biases  that  would  show  up  one  by  one  as  the  experimentation 
progressed  inconclusively. 

However,  the  results  In  Chlpaau's  almost  identical  experiment  (op. 
clt . ,  pp.  87-66)  do  give  strong  support  to  this  finding;  Chlpnan'a 
explanatory  hypothesis  differs  trm  that  proposed  below. 

^  m  order  to  relate  these  ehoioes  dearly  to  the  postulates,  let  us 
change  the  experimental  setting  slightly.  Let  us  assume  that  the  balls  In 
Urn  I  are  each  marked  with  a  Z,  and  the  balls  in  Urn  II  with  a  II;  the 
contents  of  both  urns  are  then  duaped  Into  a  single  urn,  which  then  con¬ 
tains  30  RsdII  balls,  50  Blacky  bells,  and  100  Jtedg  aod  Blacky  balls  in 
unknown  proportion  (or  in  a  proportion  Indicated  onl;  by  a  small  random 
sample,  say,  one  Red  and  one  Black).  The  following  actions  are  to  be 


considered: 
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100  50  50 

*1  ®X  *H  *11 

lab  b  b 

II  b  a  b  b 

HI  b  b  a  b 

IV  b  b  b  a 

V  a  a  b  b 


VI  b  b  a  a 

Let  ua  aaauoe  that  a  pereon  la  indifferent  between  I  and  II  (between 
betting  on  Rj  or  Bj),  between  HI  and  IV  and  between  V  and  VI.  It  would 
then  fellow  froa  Postulates  1  and  2,  the  assumption  of  a  complete  ordering 
of  act  Iona  and  the  Sure-thin*;  Principle,  that  I,  II,  HI  and  IV  are  all 
Indifferent  to  aaoh  other. 

To  lndioate  the  nature  of  the  proof,  suppose  that  I  la  preferred 
HI  (the  peraon  prafera  to  bat  on  Rj  rather  than  Rjj) .  Foatulatea  1  and  ? 
imply  that  certain  txaoaforaatlana  oan  be  performed  on  this  pair  of  actions 


■pacifically,  one  action  can 


be  replaoed  by  an  action  indifferent  to  it  (PI  —  complete  ordering)  and 
the  value  of  a  conatant  coluan  oan  be  changed  (PS  —  Sure-thlng  Principle) 
Thus  starting  with  I  and  IH  and  performing  such  "admissible  tra" 


fonnatioiWit  would  follow  from  FI  and  PS  that  the  first  action  In  each  of 
the  following  pairs  should  be  preferred: 
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*1 

®n 

*11 

I 

e 

b 

b 

b 

m 

b 

b 

e 

b 

i* 

e 

b 

b 

e 

P2 

in* 

b 

b 

e 

e 

i" 

e 

1 

b 

e 

PI 

m" 

e 

e 

b 

b 

if*. 

b 

b 

b 

e 

P2 

m»" 

b 

e 

b 

b 

jt  •  t  • 

b 

b 

e 

b 

PI 

e 

b 

b 

b 

Contradiction:  I  preferred  to  XXX,  and  I""  (equivalent  to  lit) 
preferred  to  HI'*"  (equivalent  to  l). 

10  Knight,  op.  elt.»  p.  219. 

n  Kenneth  Arvo*  bee  eiOMted  the  following  weylo,  in  the  spirit 
of  the  ebon  one: 

Jgo  90  50 

*X  *1  *xx  *xx 

Z  e  e  b  b 

XX  e  b  e  b 

XXX  b  e  b  e 

XV  b  b  e  e 

Affiant  that  X  If  Indifferent  to  IV,  XX  If  Indifferent  to  III. 

Juppoee  that  I  le  preferred  to  II;  stoat  if  the  ordering  of  III  end  I V? 

If  III  le  not  preferred  to  XV,  K,  the  iure-'thing  Principle  Is  violated. 

If  IV  Is  not  preferred  to  HI,  PI,  complete  ordering  of  actions,  Is 

violated.  (If  III  Is  Indifferent  to  I V,  both  PI  end  P2  ere  violated.) 

12 

Let  the  utility  payoffs  corresponding  to  $100  end  $0  be  1,  0;  let 
?1,  P2,  Pj  be  the  probabilities  corresponding  to  Rod,  Yellow,  Black.  The 
expected  value  to  action  I  Is  then  P^;  to  U,  ?2;  to  HI,  P^  +  Py  to 
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IV,  ?2  4  fy  But  there  are  no  P'a,  >  o-  ZP^  ■  1,  s*ch  that  P,  >  P£ 

\4 
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Px  4  p?  <  pg  4  P^. 


,  P.,  "Probability  and  tha  Attests  to  Measure  Utility/ 


(Toloro,  Japan),  July  1950,  pp.  169-170. 


Vo  test  tha  predictive  effectiveness  of  tha  axlona  (or  of  tha  alter¬ 
nate  dad  doc  rule  to  ba  proposed  In  tha  next  aectlon)  in  thaae  dtuationw 
controlled  acperlnsntatlon  la  In  order.  (Baa  CMjnan'a  lnganious  experlaoL 


or.  dt.)  But,  aa  Savage  raaarta  (or.  cit « ,  p .  26) ,  tha  ante  of  interroga- 
tlon  lapliad  hare  and  In  Savage's  book,  aaklng  "tha  paraon  not  hov  ha  f^.*.- 
but  test  ha  would  do  In  such  and  auah  a  situation"  ad  giving  him  aqple 


opportunity  to  ponder  tha  Implication*  of  hia  rapliaa,  aaana  quite  appropr*  - 
ate  in  ald>1n|  "tea  theory's  core  tportat  normative  intarpratatlon. ' 
Moreover,  teaaa  uou  anpartnantal  observations  oan  have  at  least  negative 
aqplrleel  implications,  ainoe  team  is  a  pnaaptin  teat  people 
instinctive  ohoioee  violate  tea  lavage  tew,  «d  who  dale  upon  further 
reflection  teal  ttey  do  oat  vent  to  obey  tten,  do  not  tend  to  obey  than 
m  anally  in  ante  dteadano. 

**  Mo  ana  teoaa  doaiteona  van  booed  on  "regret*"  oould  violate  the 
flura  tetm  Frinelfle,  ainoe  all  oanetent  ooltaaw  of  payoff*  would  tranafom 
to  o  colon  of  O'a  la  tana  of  "regret";  an  the  other  hand,  euch  a  paraon 
w>uld  violate  PI,  oanpiete  ordering  of  strategies. 
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Baa  Chljnar,  or.  dt.,  pp.  75,  93.  Chlpnan'a  b^ortent  work  in 
thla  area,  dona  independently  and  largely  prior  to  nine,  la  not  dlecuaaed 
bare  ainoe  it  aabodlea  a  atoehaatie  theory  of  choice;  lta  aplrlt  ia 
otha  vlaa  cloealy  similar  to  that  of  the  present  approach,  and  hia  expert  - 
cental  results  are  both  pertinent  and  favorable  to  the  hypotheses  belov 


-Til 


(though  Chlpaan's  Inferences  art  aaaewtant  different) . 

8m  alao  the  oaMOti  by  V*  Owpwn  teipi  an  notion  of 
"credibility,"  *  oonoapt  Identical  to  "naMgulty"  la  till*  paper:  "The 
fctm  of  iftqpeetatian  aad  teeartelutr, "  la  tooctetlona.  Oboertalnty.  and 
BnolnoM  labaelor.  «A.  Nuy  Brnw,  8odal  Science  Ha  March  Connell, 

Raw  Tart,  1958,  pp.  24-26;  «A  tfaodoe,  Rspectafcions  and  Reaeurabllity," 
Quarterly  Journal  a?  Bnanaalca,  Rel.  XXTXXI,  Bo.  4,  fcraahar  1954* 
pp.  527-530.  Thaae  highly  pertinent  artlclM  oom  to  ay  attention  only 
after  thla  paper  haA  gone  to  ttaa  printer,  allorlai  no  apace  fbr  ooanant 
bar*. 

^  omp,  S<  dt..  pp.  57-58,  59*  Imp  IPar  paa  ao  far  aa  to 
suggest  (up-  dt.«  pp.  158-169)  tea*  ten  "aura  of  Tapamoao'*  atteohaA  to 
aaogr  Judgments  of  poraanal  pratehility  at#  laaA  to  ytanatlc  violations 
of  hla  miens,  alteeu#  tea  Aaalaim  role  ho  Aloouooaa  aa  altemetlve— 
aln  leaning  rape*— amnot,  a*  emtesand  U  feeteete  14  ahovo,  aooount  lor 
tea  batertar  la  our  sample#. 

17  ft.  H|.#  ».  •*. 

^  fhla  nantrtel  H  tea  aaaartlaaa  ty  Ctbljnm  (g.  dt. .  p.  68)  and 
Oeoipsecu-ltoegm  (ttaedee,  Pparttelma  and  ManeurnblUty,"  pp.  527-530), 
and  "Ttaa  Raton  of  aparlnllon  and  Hhaartalnty,"  p.  85)  teat  ladlrlAwalr 
order  uaoartalaty-altnnM  nan  Im  Taguphlaall)  In  team  of  aatlnatad 
expectation  and  "cradlblllty"  (aahipiity) ;  atelgulty  appears  to  Influence 

choice  even  whan  aatlaateA  expectations  are  not  equivalent. 

19 

This  rule  la  baaaA  upon  ttaa  oonoapt  of  a  "restricted  Bayes 
solution"  developed  by  J.  L.  Hodges,  Jr.,  sal  E.  L.  ("The  Uses  of 

Previous  fiqwrlanoe  In  Beaching  Statistical  Decision, "  s»n»i«  Qf 
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MsttsneM  ml  atetlstlos,  Ibl.  83*  *>•  3,  Bapt^her,  1952,  ».  396-407, 
fhe  discussion  ttimiijhnar  Bastion  ZZZ  of  this  paper  derives  hawUy  trm 
the  flsdfse  asd  Umb  iifoant,  although  their  «proaoh  la  activated  and 

Am  also,  L.  Burwlca,  "Boas  apecJLfi  cation  Prubloae  and  Applications 
to  Baononstrlc  Mod* la,"  Ironnnetrlon.  fol.  19,  Bo.  3,  July,  1951,  HP* 
543-34*  (abstract) .  This  deals  with  the  coca  sort  of  problen  ad  presents 
a  "panllMd  lfM^latMK  principle"  efulvalont,  In  sore  general  fata, 
to  the  dart  slon  rule  Z  proposed  In  an  earlier  we  sent  at  ion  of  tills  paper 
(SaMNafeer,  I960) ;  tot  both  of  these  lacked  the  crucial  notions  developed 
la  the  Maes  aad  Lahnaan  approach  of  a  "bast  ectlaate"  distribution  y° 
end  a  "ooafUtaaoe"  pamatar  A 

®  **a  Wqnlrtlff  af  11m  hahmrtor  pattani  ooatraats  to  the 

artlala  la  ttdi  qMpaadtau  MJaar  aaaaa  vaalstahahly  to  ba  deal  Inc  rtth 

a  paraaa'a  djJtaHn  |W^IM1Im  aad  utilities  la  relatively 
"umbM#mm"  attaadddBa  gad  than  aaftag  thaaa  aaasurrmanta  to  calibrate 

aoaraa  af  aav  data  wd  hypotheses.  Mscaover,  bit  daaorlptlva  data  and 
intuitive  soajsirlnrse  lead  eaeemrag&ng  nnirrt  to  the  findings  reported 
bars,  Bowsver,  his  aolatloa  to  the  problem  supposes  a  slagla  set  of 
weijdita  determined  Indspeodsatly  of  payoffs  (presumably  corresponding  to 
the  "beat  aatlaataa"  ban)  aad  a  "correction  factor,"  reflecting  the 
degree  of  atolguity  or  oonfldanoa,  vhlch  operates  on  the  as  weights  in  a 
aanaer  lodepandect  of  the  atructure  of  p^roffs.  I  mi  not  entirely  clear 


an  t tm  betwriosml  Implications  of  Miner 'u  aodel  or  tbr  decision  rule  It 
implies,  lot  in  view  of  these  properties  I  an  doubtful  whether  It  can 
ecoonat  adafjst*]^  fbr  ell  tile  betevlor  diocuesed  above. 


RISK,  AMBIGUITY,  AND  THE  SAVAGE  AXIOMS 
Daniel  Ellaberg* 

The  RAND  Corporation,  Santa  Monica,  California 

I.  ARE  THERE  UNCERTAINTIES  THAT  ARE  NOT  RISKS? 

There  has  always  been  a  good  deal  of  skepticism  about  the  behavioral 
significance  of  Frank  Knight's  distinction  between  "measurable  uncertainty"  o 
"risk,"  which  ray  be  represented  by  numerical  probabilities,  and  "unmaasurab' 
uncertainty"  which  cannot.  Knight  maintained  that  the  latter  "un  rtainty" 
prevailed  —  and  hence  that  numerical  probabilities  were  inapplicable  --in 
situations  when  the  decision-maker  was  Ignorant  of  the  statistical  freque,  - 
cies  of  events  relevant  to  his  decision;  or  when  a  priori  calculations  were 
impossible;  or  when  the  relevant  events  were  in  some  sense  unique;  or  when  a; 
important,  once -and- for- all  decision  was  concerned.  (For  this  and  subseque 
footnotes,  see  end  of  paper.) 

Yet  the  feeling  has  persisted  that,  even  in  these  situations,  people  ten 
to  behave  "as  if"  they  assigned  numerical  probabilities,  or  "degrees  ol 
belief,"  to  the  events  impinging  on  their  actions.  However,  it  is  hard  elthe 
to  confirm  or  to  deny  such  a  proposition  in  the  absence  of  precisely-defined 
procedures  for  measuring  these  alleged  "degrees  of  belief." 
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Any  views  expressed  in  this  paper  are  those  of  the  author.  They  should 
not  he  interpreted  as  reflecting  the  views  of  The  RAND  Corporation  Or  the 
official  opinion  or  policy  of  any  of  its  governmental  or  private  research 
sponsors-  Papers  are  reproduced  by  The  RAND  Corporation  as  a  courtesy  to 
members  of  it3  staff. 

Research  for  this  paper  was  done  while  the  author  was  a  member  of  the 
Society  of  Fellows,  Harvard  University,  1957*  An  earlier  version  was  read 
before  the  Econometric  Society  at  its  December  i960  meeting  in  3t.  Louis; 
and  the  present  version  incorporating  changes  in  Section  III  will  appear  in 
the  November  1961  issue  of  the  Quarterly  Journal  of  Economics,  in  a  symposium 
on  decision-making  under  uncertainty,  together  with  a  contribution  by 
William  Fellner  and  a  note  on  the  present  paper  by  Howard  Raiffa.  In  re¬ 
vising  Section  III,  the  author  was  particularly  stimulated  by  discussions 
with  A.  Madansky,  T.  Schelling,  L.  Shapley,  and  S.  Winter. 
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What  night  it  man  operationally,  in  tame  of  refutable  predictions  about 
observable  phenomena,  to  say  that  someone  behaves  "as  if"  he  assigned  quanti¬ 
tative  likelihoods  to  events:  or  to  say  that  he  does  not?  An  intuitive 
answer  may  emerge  if  we  consider  an  exangle  proposed  by  Shackle,  who  takes 
an  extreme  form  of  the  Khlgbtlan  position  that  statistical  information  on 
frequencies  within  a  large,  repetitive  class  of  events  is  strictly  irrelevant 
to  a  decision  whose  outcome  depends  on  a  single  trial.  3hackle  not  only 
rejects  numerical  probabilities  for  representing  the  uncertainty  in  this 
situation;  he  maintains  that  in  situations  where  all  the  potential  outcomes 
seem  "perfectly  possible”  in  the  sense  that  they  would  not  violate  accepted 
lavs  and  thus  cause  "surprise,"  it  is  impossible  to  distinguish  meaningfully 
(l.e.,  in  terms  of  a  person's  behavior,  or  any  other  observations)  between 
the  relative  "likelihoods"  of  these  outcomes.  In  throwing  a  die,  for  Instance, 
It  would  not  surprise  us  at  all  if  an  ace  came  up  on  a  single  trial,  nor  if,  cr 
the  other  hand,  sons  other  amber  aene  up.  So  Shackle  concludes: 

3uppoae  the  captains  In  a  Test  Natch  have  agreed  that  instead  of 
tossing  a  coin  for  a  choice  of  Innings  they  will  decide  the 
matter  by  this  next  throw  of  a  die,  and  that  If  it  shows  an  ace 
Australia  shall  bat  first,  if  any  othsr  number,  then  Bigland 
shall  bat  first.  Can  we  now  give  any  meaningful  answer  whatever 
to  the  question,  "Who  will  bat  first?"  except  "We  do  not  knov?"2 

Most  of  us  might  think  vs  could  give  better  answers  than  that.  We  could 

say,  "England  will  bat  first,"  or  mors  cautiously:  "I  think  England  will 

probably  bat  first."  And  If  Shackle  challenges  us  as  to  what  we  "mean"  by 

that  statement,  it  Is  quite  natural  to  reply:  "We'll  bet  on  England;  and 

we'll  give  you  good  odds." 

It  so  happens  that  in  this  case  statistical  information  (on  the 
behavior  of  dice)  is  available  and  does  seem  relevant  even  to  a  "single 
shot"  decision,  our  bet;  it  will  affect  the  odds  we  offer.  As  Damon  Runycn 
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once  Mid,  "The  race  Is  not  always  to  the  swift  nor  the  battle  to  the 
strong,  but  that's  the  way  to  bet.*'  However,  it  is  our  bet  itself,  and  not 
the  reasoning  and  evidence  that  lies  behind  it,  that  gives  operational 
meaning  to  our  statement  that  we  find  one  outcome  "acre  likely"  than 
another.  And  we  may  be  willing  to  place  bets  —  thus  revealing  "degrees 
of  belief"  in  a  quantitative  form  —  about  events  for  which  there  is  no 
statistical  information  at  all,  or  regarding  which  statistical  information 
seems  in  principle  unobtainable.  If  our  pattern  of  bets  were  suitably 
orderly  —  if  it  satisfied  certain  postulated  constraints  —  it  would  be 
possible  to  infer  for  ourselves  numerical  subjective  probabilities  for 
events,  in  terms  of  which  some  future  decisions  could  be  predicted  or 
described.  Thus  a  good  deal  —  perhaps  all  --  of  Knight ' g  class  of 
"unmeasurable  uncertainties"  would  have  succumbed  to  measurement,  and 
"risk"  would  prevail  Instead  of  "uncertainty . " 

A  number  of  seta  of  constraints  on  choice-behavior  under  uncertainty 
have  now  been  proposed,  all  more  or  leas  equivalent  or  closely  similar  in 
spirit,  having  the  implication  that  --  for  a  "rational"  man  —  all  uncer¬ 
tainties  can  be  reduced  to  risks. ^  Their  flavor  is  suggested  by  Ramsay's 
early  notions  that,  "The  degree  of  a  belief  is. .  .the  extent  to  which  we 
are  prepared  to  act  upon  it,"  and  "The  probability  of  1/3  is  clearly 
related  to  the  kind  of  belief  which  would  lead  to  a  bet  of  2  to  l."1* 
Starting  from  the  notion  that  gambling  choices  are  Influenced  by,  or 
"reflect,"  differing  degrees  of  belief,  this  approach  sets  out  to  infer 
those  beliefs  from  the  actual  choices.  Of  course,  in  general  those  choices 
reveal  not  only  the  person's  relative  expectations  but  his  relative  prefer¬ 
ences  for  outcomes;  there  is  a  problem  of  distinguishing  between  these. 
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But  If  one  picks  the  right  choices  to  observe,  and  If  the  Savage  postulates 
or  some  equivalent  set  are  found  to  be  satisfied,  this  distinction  can  be 
made  unambiguously,  and  either  qualitative  or,  Ideally,  numerical  proba¬ 
bilities  can  be  determined.  The  propounders  of  these  axioms  tend  to  be 
hopeful  that  the  rules  will  be  commonly  satisfied,  at  least  roughly  and 
most  of  the  time,  because  they  regard  these  postulates  as  normative  maxims, 
videly-acceptable  principles  of  rational  behavior.  In  other  words,  people 
should  tend  to  behave  In  the  postulated  fashion,  because  that  is  the  way 
they  would  want  to  behave.  At  the  least,  these  axioms  are  believed  to 
predict  certain  choices  that  people  will  make  when  they  take  plenty  of 
time  to  reflect  over  their  decision,  in  the  light  of  the  postulates. 

In  considering  only  deliberate  decisions,  than,  does  this  leave  any 
roam  at  all  for  "unmeasurable  uncertainty*:  fat  uncertainties  not  reduc¬ 
ible  to  "risks,"  to  quantitative  or  qualitative  probabilities? 

A  side  effect  of  the  axiomatic  approach  la  that  It  supplies,  at  last 
(as  Xhlght  did  not),  a  useful  operational  meaning  to  the  proposition  that 
people  do  not  always  assigned,  or  act  "as  though"  they  assigned,  probabil¬ 
ities  to  uncertain  events.  The  omening  would  be  that  with  respect  to 
certain  events  they  did  not  obey,  nor  did  tney  wish  to  obey  --  even  on 
reflection  —  Savage's  postulates  or  *qulvalen,  rules.  One  could  emphasize 
here  either  that  the  postulates  ft' ’cl  to  bo  acceptable  In  those  circum¬ 
stances  as  normative  rules,  or  that  they  failed  to  predict  reflective 
choices;  I  tend  to  be  more  interested  in  the  latter  aspect,  Savage  no 
doubt  in  the  former.  (A  third  Inference,  which  H.  Half ft  favor u,  could  be 
that  people  need  more  drill  on  the  importance  of  conforming  to  the  Savage 
axioms.)  But  from  either  point  of  view,  It  would  follow  that  there  would 
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b>  simply  no  wy  to  Infer  meaningful  probabilities  for  those  grants  from 
their  choices,  and  theories  which  purported  to  describe  their  uncertainty 
In  tanas  of  probabilities  would  be  quite  Inapplicable  In  that  area  (unless 
quite  different  operations  for  measuring  probability  were  devised) .  More- 
over,  such  people  could  not  be  described  as  maximising  the  mathematical 
expectation  of  utility  on  the  basis  of  numerical  probabilities  for  those 
events  derived  on  any  basis*  Nor  would  it  be  possible  to  derive  numerical 
"von  Neuounn-Jtorgenstern  '  utilities  from  their  choices  among  gambles 
involving  those  events. 

I  propose  to  Indicate  a  class  of  choice* situations  in  which  many 
otherwise  reasonable  people  neither  wish  nor  tend  to  conform  to  the 
Savage  postulates,  nor  to  the  other  axiom  sets  that  have  been  devised. 

But  the  implications  of  such  a  finding,  if  true,  are  not  wholly  destructive. 
First,  both  the  predictive  and  normative  use  of  the  Savage  or  equivalent 
postulate#  might  be  improved  by  avoiding  attempts  to  apply  them  in  certain, 
specifiable  circumstances  where  they  do  not  seem  acceptable.  Second,  ve 
might  hope  that  It  la  precisely  in  such  circumstances  that  certain 
proposals  for  alternative  decision  rules  and  n on-probabilistic  descriptions 
of  uncertainty  (e.g.,  fay  Xhlght,  Shackle,  Burvlcz,  and  Bodges  and  Lehmann) 
might  prove  fruitful.  I  believe,  in  fact,  that  this  la  the  case. 


n.  UNCBffAXKFISB  THJff  ARE  WX  RISKS 


Which  of  tvc  event  a,  at,  p,  does  an  individual  consider  "more  likely"? 
In  the  Rans^-Sevage  approach,  the  basic  test  is:  Oa  vhlch  event  would 
he  prefer  to  stake  a  prize,  or  to  place  a  given  bet?  By  the  phrase, 

"to  offer  a  bet  on  or"  we  shall  mean:  to  make  available  an  action  with 
consequence  a  if  a  occurs,  (or,  as  Savage  puts  It,  If  a  "obtains") 
and  b  If  4c  does  not  occur  (i.e. ,  If  5,  or  "not-ac"  occurs),  where  a 
lc  preferable  to  b. 

Suppose,  then,  that  we  offer  a  subject  alternative  bets  "an"  a 
and  "on"  0  (a,  0  need  not  be  either  Virtually  exclusive  or  exhaustive, 


but  for 


mutually  exclusive). 


Oeatolea 


la  all  illustrations 


they  are 


a  p 


I  a 


n  |b 


The  Rama v*fo vage  proposal  is  to  interpret  the  person's  preference 
between  I  ard  II  aa  revealing  the  relative  likelihood  hft  assigns  to  a 
and  p.  If  he  does  not  definitely  prefer  II  to  I,  it  :ls  te  be  inferred 
that  he  regards  a  as  "not  lass  probable  than”  P,  which  we  will  write: 
a  -  p. 

For  example,  in  the  caae  of  Suckle' s  illustration,  ve  might  be 
allowed  to  bet  either  that  will  bat  first  or  thst  Australia 

will  (these  two  events  being  complementary),  staking  a  $10  prise  in 


England  first 

I  $10  ~ 


either  case: 


II 


Australia  first 
$0 

$10 
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If  the  event  were  to  he  determined  by  the  toee  of  e  die,  England  to  bat 
first  if  any  mnber  but  an  ace  turned  up,  I  would  strongly  prefer 
gmable  Z  (and  if  Shackle  should  really  claim  indifference  between  I  and  II, 

I  would  be  anxious  to  make  a  side  bet  with  him).  If,  on  the  other  hand, 
the  captains  were  to  toss  a  coin,  I  would  be  indifferent  between  the  two 
bets.  In  the  first  caee  an  observer  might  infer,  on  the  basis  of  the 
Bsasey>8avags  axioms,  that  I  regarded  England  as  more  likely  to  bat  first 
than  Australia  (or,  an  ace  ee  lees  likely  than  not  to  cane  up);  in  the 
second  case,  that  X  regarded  Heeds  and  Tails  as  "equally  likely. " 

That  inference  yould,  in  fact,  be  a  little  hasty.  )ty  indifference 
in  the  second  caee  would  indeed  indicate  that  I  assigned  equal  probabilities 
to  Heeds  and  Tails,  if  I  assigned  any  probabilities  at  all  to  those  events; 
but  the  letter  condition  would  remain  to  be  proved,  and  it  would  take 
further  choices  to  prove  it.  I  might,  for  example,  be  e  "minimaxer, " 
whose  indifference  between  the  two  bets  merely  reflected  the  fact  that 
their  respective  "worst  outcomes"  were  identical.  To  rule  out  such 
possibilities,  it  would  be  necessary  to  examine  my  pattern  of  preferences 
in  a  number  of  well-chosen  cases,  in  the  light  of  certain  axiomatic 
constraints* 

In  order  for  any  relationship  (^srnong  events  to  have  the  properties 
of  a  "qualitative  probability  relationship,"  it  must  be  true  that: 

(a)  (T)  is  a  complete  ordering  over  evwnte;  for  any  two  events  a,  p, 
either  a  is  "not  less  probable  than"  P,  or  P  is  "not  less  probable  than” 
a,  and  if  a  >  p  and  P  >  7,  then  a  >  7. 

(b)  If  a  is  more  probable  than  p,  then  "not>Of"  (or,  &)  is  less  probable 
than  not-p  (Mj  If  a  is  equally  probable  to  S,  and  p  is  equally  probaWe 


-8- 


to  P,  than  a  it  equally  probable  to  fi. 

(c)  If  0!  and  7 are  mutually  exclusive,  and  so  are  0  and  7 (i. e. ,  if  a/>y» 
p/>7  ■=  0),  sod  if  a  is  more  probable  than  P,  than  thr  union  (au?  )  is  more 
probable  than  (Pc/7  ). 

&  vagi  proves  that  the  relatlonahip^)«Bon£  events,  inferred  aa  above 
from  choices  among  gmbles,  will  have  the  above  properties  if 
the  individual's  pattern  of  choices  obeys  certain  postulates.  Tb  indicate 
sane  of  these  briefly: 

PI:  Complete  ordering  of  gmsbles,  or  "actions. *  In  the  example 
below  either  I  is  preferred  to  II,  II  is  preferred  to  I,  or  I  and  II  are 
indifferent.  If  I  is  preferred  to  II,  and  II  is  preferred  or  indifferent 
to  III,  then  I  is  preferred  to  HI  (not  aboan). 


a  fi  fel 


PS:  The  choice  between  tee  actions  must  be  unaffected  by  the  value 
of  payoffs  corresponding  to  events  for  which  both  met  lens  have  the  ssae 
payoff  (l.e.,  by  the  value  of  payoffs  in  a  constant  column  ).  Thus,  if 
the  subject  preferred  I  to  ZZ  In  the  example  above,  he  should  prefer 
III  to  IV,  below,  when  a  end  b  are  unchanged  end  c  takes  aay  value: 


This  corresponds  to  Savage's  fbstulste  2,  which  he  cells  the  "Sure- 
Thin^  Principle"  and  which  beers  greet  weight  in  the  analysis.  One 
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rational*  for  It  Mount*  to  tba  following:  Suppose  that  a  parson  would 
not  prafar  IV  to  ZZZ  If  ha  knew  that  tha  third  colxan  would  not  *obtein"j 
if#  on  tha  othar  hand,  ha  knav  that  tha  third  eoluan  would  obtain,  ha 
would  at  ill  not  prafar  XV  to  XZZ,  since  tha  payoffs  (whatever  they  are) 
are  equal.  So,  since  ha  would  not  prefer  IV  to  III  "in  either  event,* 
ha  should  not  prefer  IV  whan  ha  does  not  know  whether  or  not  tha  third 
eoluan  will  obtain. 

*l)tcapt  posaibly  for  tha  assumption  of  a  lapis  ordering,*  Savage 
assarts,  *X  know  of  no  other  extralogical  principle  governing  decisions 
that  finds  such  ready  acceptance.**’ 

ft:  The  choice  in  the  above  ammpla  oust  be  independent  of  the  values 
of  a  and  b,  given  their  ordering.  Thus,  preferring  I  to  H,  the  subject 
should  prefer  V  to  VI  below. 


▼ 

VI 

This  is  Savage's  fostulate  4,  the  independence  of  probabilities  and  pay¬ 
offs.  Roughly,  it  specifies  that  tha  choice  of  event  on  which  a  person 
prefers  to  staks  a  prise  should  not  he  affected  by  the  also  of  the  prise. 

In  combination  with  a  "non- controversial"  Postulate  P3,  (corresponding 
to  "admissibility",  tha  rejection  of  dominated  actions),  these  four 
postulates,  If  generally  satisfied  by  the  individual's  choices,  imply 
that  hie  preference  for  I  over  XI  (  or  III  over  IV,  or  V  over  VI)  nay 
safely  be  interpreted  aa  sufficient  evidence  that  he  regards  a  ss  "not 
less  probable  than"  fij  the  relationship  "not  l^i  probable  than"  thus 
operationally  defined,  will  have  all  the  properties  of  s  "qualitative 


whan  d  >  at 
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probability  relatlonahip."  (Other  postulates,  which  will  not  be 
considered  here,  are  necessary  in  order  to  establish  mass ri cal  probabil¬ 
ities.)  In  general,  as  one  ponders  these  postulates  and  tests  them  int re¬ 
spectively  in  a  variety  of  hypothetical  situations,  they  do  Indeed  appear 
plausible.  That  is  to  say  that  they  do  seen  to  have  vide  validity 
as  noraatlve  criteria  (for  ae,  as  well  as  for  Savage);  they  are  probably^ 
roughly  accurate  in  predicting  certain  aspects  of  actual  choice  behavior 
ir.  may  situations  and  better  yet  in  predicting  reflective  behavior  in 
those  situations,  to  the  extent  this  ie  true,  it  should  be  poeslble  to 
Infer  fraa  certain  gidhUng  choice*  in  those  situations  at  least  e 
qualitative  probability  relationship  aver  events,  corresponding  to  a 
given  person's  "degrees  of  belief." 

Let  us  now  consider  aoa»  situations  in  which  the  Savage  axiom  do 
not  seen  so  plausible:  nlrm— tisnnss  in  which  none  of  the  above  oonclu- 

■  -  a 

alons  nay  appear  valid. 

Consider  the  foUowlng  hypothetical  exper leant.  Let  us  suppose 

that  you  confront  two  mas  containing  red  end  blade  balls,  from  one  of 
which  a  ball  vii:  be  drawn  at  randoa.  to  "bet  on  Rad^"  will  own 
that  you  choose  to  draw  from  Urn  X;  and  that  you  will  receive  a  prize  a 
(say  $100)  if  you  draw  a  red  hall  ("if  Rsd^  occurs")  end  a  saaller 
amount  b  (say,  $0)  if  you  draw  a  black  ("if  not-Red^  occurs"). 

You  have  the  following  Information.  Urn  I  contains  100  red  and 
black  boUs,  but  in  a  ratio  entirely  unknown  to  you;  there  may  be  from 
0  to  100  red  balls.  In  Urn  II,  you  confirm  that  there  are  exactly  50 
red  and  50  black  bolls.  An  observer  —  who,  let  us  say,  is  ignorant  of 
the  state  of  your  Information  about  the  urns  —  sets  out  to  measure 
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your  auhj  active  probabilities  by  internet  lag  you  aa  to  your  preference* 
in  tha  following  pair*  of  pnhlaai 

1.  "Which  do  you  parofOr  to  hot  on,  Badj  or  Blacky  i  or  *r*  you 
Indifferent?"  Seat  la,  drawing  a  ball  fraa  Urn  Z,  on  which  "event"  do 
you  pvnfUr  tho  $100  ataka.  Mad  or  Black:  or  do  yuu  carat 
8.  "Which  would  you  prefer  to  bat  «^n  “ 

3.  "Vhlrh  do  you  iwftr  to  tot  oo>  Mj  or  Madjjt"7 

k.  "lfclch  do  you  prafar  to  bat  on.  Blacky  or  Blanket"7 

Xat  ua  ■nr«—  that  in  both  th*  firat  caaa  and  the  aaoand  oaaa,  you 

Q 

era  indifferent  (the  typical  raaponaa).  Judging  fraa  a  large  nueber  of 
rrpnnaaa,  under  abaalutaly  non  aaparlaantal  condition*,  your  aaawnra  to 
tbaao  laat  two  gwUnna  ara  likaly  to  fall  into  on*  of  thro*  croupe.  You 
Mgr  etill  bo  indiffarant  within  aaah  pair  of  optiona.  (If  ao,  you  nay  ait 
back  now  and  wntoh  for  anhilo).  Bat  if  you  ar*  in  tha  nejority,  you  will 
r apart  that  pan  yawflar  to  bat  aa  BMn  rathar  than  Mj,  and  llank^ 
rather  than  Haakj.  fha  prafbranoea  of  a  aaall  Minority  un  the  other  way, 
praferrlng  bate  on  Baig  to  fcad^,  and  Blacky  to  Blacky. 

Zf  you  ara  in  althar  of  thaaa  latter  groi^a,  you  art  now  in  trouble 
with  tha  Bmp  art  on*. 

Suppoae  that,  bet*  *ng  on  Bad,  you  preferred  to  draw  out  of  Urn  II. 

An  obeerrer,  applying  the  baeic  rule  of  tha  Manaay/Sevage  approach, 
would  infer  tantativaly  that  you  regarded  Rad^  aa  "more  probably  than" 
Redj.  lie  tijon  ohearva*  that  you  alao  prefer  to  bet  on  Blacky  rather 
than  Blacky.  L.  .ce  he  cannot  conclude  that  you  regard  RecL^  as  more 
probable  t ban  Red.  ■■■*.  at  the  sane  time,  not-Redjj  aa  more  probable 
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than  not-Redj  —  this  being  inconsistent  with  tbs  essential  properties  of 
probability  relstleoehlpe  —  he  Bust  conclude  thet  your  choices  ere 
not  revealing  Judges eats  of  "probebillty"  et  ell.  do  far  es  these  events 
ere  concerned,  it  is  impossible  to  infer  probabilities  from  your  choices; 
you  suet  inevitably  be  violating  sobs  of  the  Savage  ax  lens  (specifically, 

FI  and  P2,  caoplete  ordering  of  actions  and/or  the  Sure- thing  Principle).^ 

The  sene  applies  if  you  preferred  to  bet  on  Rad^  and  Blacky  rather 
than  **4i  or  Blacky.  Moreover,  harking  back  to  your  earlier  (hypothetical) 
replies,  any  one  of  these  preferences  Involves  you  in  conflict  with  the 
axiom*.  For  if  one  is  to  interpret  fron  .our  answers  to  the  first  two 
questions  that  Redg  is  "epially  likely*  to  not-Redj,  and  Bsd^.  is  equally 
likely  to  not-Sad^,  than  Red j  (or  Blacky)  should  be  equally  i  ■  to 
Bed^j  (or  to  Blacky),  and  any  pssfersnoo  for  drawing  front  one  urn  over 
the  other  leads  to  a  contradiction. ^ 

Zt  si#d  be  Objected  that  the  as—ad  total  igmence  of  the  ratio 
of  rod  and  bleak  balls  Ir  QhtZissn  unrealistic  csnditlon,  leading  to 
erratic  decisions.  1st  us  Bugsss  instead  that  you  have  been  allowed  to 
drew  a  random  eagle  of  two  bolls  from  thm  Z,  and  that  you  have  drown  one 
red  and  one  black.  Or  a  angle  of  fours  two  red  and  two  black.  Such 
conditions  do  not  seas  to  change  the  observed  patten  of  choices  appreciably 
(although  tbs  reluctance  to  draw  frost  Urn  Z  goes  down  somewhat,  as  shown 
for  example,  by  the  maount  s  subject  will  pay  to  drew  from  Urn  I;  this 
still  retains  well  below  what  he  will  pay  for  Um  II).  The  same  conflicts 
with  the  axioms  appear. 

Long  after  beginning  these  observations,  I  discovered  recently  that 
Khieiit  had  postulated  an  identical  c coper i son,  between  a  man  who  knows  that 
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there  are  red  and  black  balls  In  an  urn  but  Ig  ignorant  of  the  numbers 
of  each,  and  another  who  knows  their  exact  proportion.  The  results 
Indicated  above  directly  contradict  Slight' s  own  intuition  about  the 
situation:  "It  aust  be  admitted  that  practically,  if  any  decision  as  to 

conduct  is  involved,  such  as  a  wager,  the  first  man  would  have  to  act  on 

_10 

the  supposition  that  the  chances  are  equal.  If  indeed  people  were 
c cupelled  to  act  on  the  basis  of  sane  Principle  of  Insufficient  Reason 
when  they  lacked  statistical  information,  there  would  be  little  interest 
in  Slight's  own  distinctions  between  risk  and  uncertainty  so  far  as 
conduct  were  involved.  But  as  many  people  predict  their  own  conduct  in 
such  hypothetical  situations,  they  do  not  feel  obliged  to  act  "as  if" 
tuey  assigned  probabilities  at  all,  eqpal  or  not,  in  this  state  of 
i. 510  ranee. 

Another  example  yields  a  direct  test  of  one  of  the  Savage  post’fLui-os- 


Imagine  an  urn  known  to  contain  30  red  balls  and  60  black  and  yellow  balls, 

the  latter  In  unknown  proportion.  (Alternatively,  Imagine  that  a  sample 

of  two  drawn  from  the  60  black  and  yellow  balls  has  resulted  In  one  black 

and  one  yellow).  One  ball  Is  to  be  drawn  at 

random 

from  the  um; 

the  following  actions  are  considered: 

30 

to 

Red 

Black 

Yellow 

I  $100 

$0 

$0 

II  $0 

$100 

$0 

Action  I  Is  "a  bet  on  Red,"  II  is  "a  bet  or. 

Black." 

Which  do  you  prefer'.’ 

Now  consider  the  following  two  actions,  under  the  sane  ciicunr.taaces: 

30 

to 

Red 

Black 

Yellow 

III  $100 

$0 

$100 

IV  $0 

$100 

$10G 

Action  III  is  a  "bet  on  Bad  or  Yellow”;  IV  is  a  ”b«t  on  Black  or  Yellow.” 
Which  of  these  do  you  prefer!  Take  your  time! 

A  very  frequent  pattern  of  response  Is:  action  I  preferred  to  II, 
and  IV  preferred  to  III.  Less  frequent  1st  II  preferred  to  I,  and  III 
preferred  to  IV.  Both  of  these,  of  course,  violate  the  Sure- thing 
Principle,  which  requires  the  ordering  of  I  to  II  to  be  preserved  in 
III  and  IV  (since  the  two  pairs  differ  only  in  their  third  column, 
constant  for  each  pair).11  The  first  pattarn,  for  example,  irqplies  that 
the  subject  prefers  to  bet  "on"  Red  rather  than  "on"  Black;  and  he  also 
prefers  to  bet  "against"  Bed  rather  than  "spinet"  Black.  A  relationship 
"inoro  likely  than"  inferred  from  his  choice*  would  fail  condition  (b)  above 
of  a  "qualitative  probability  relationship,"  since  it  would  indicate  that 
no  regarded  Red  as  more  likely  than  Black,  but  also  "not-Rsd”  as  more 
likely  than  "not -Black. "  Moreover,  he  vox  Id  be  acting  "as  though"  he 
retarded  "Red  or  Yellow”  as  lass  likely  than  "Black  or  Yellow,”  although 
Red  were  more  likely  than  Black,  and  Rad,  Yellow  and  Black  were  mutually 
exclusive:  thus  violating  condition  (c)  above. 

Once  again,  It  is  impossible,  on  the  basis  of  such  choices,  to  infer 
even  qualitative  probabilities  for  the  events  in  question  (specifically, 
for  events  that  include  Yellow  or  Black,  but  not  both) .  Moreover,  for  any 
values  of  the  payoffs,  it  is  impossible  to  find  probability  nuribera  in 
term  of  which  these  choices  could  be  described  --  even  roughly  or 

Ik 

approximately  --  as  maximizing  th.  mathematical  expectation  of  utility. 

You  might  now  pause  to  reconsider  your  replies.  If  you  should  repent 
of  your  violations  —  if  you  should  decide  that  four  choices  inlying 
conflicts  with  the  axiom  were  "mistakes"  and  that  your  "real"  preferences. 


15 


upon  reflection,  Involve  no  such  inconsistencies  —  you  confirm  that  the 
Savage  postulates  are,  if  not  descriptive  rules  for  you,  your  normative 
criteria  in  these  situations.  But  this  is  by  no  means  a  universal 
reaction;  on  the  contrary,  it  would  be  exceptional. 

Responses  do  vary.  There  are  those  who  do  not  violate  the  axioms, 
or  say  they  won't,  even  in  these  situations  (e.g.,  G.  Debreu,  R.  Schlalffer 
P.  Saauelson);  such  subjects  tend  to  apply  the  axioms  rather  than  their 
intuition,  and  when  in  doubt,  to  apply  some  form  of  the  Principle  of 
Insufficient  Reason.  Some  violate  the  axioms  cheerfully,  even  with  gusto 
(J.  Murschak,  N.  Dalkey);  others  sadly  but  persistently,  having  looked 
into  their  hearts,  found  conflicts  with  the  axioms  and  decided,  in 
Samuel  son 's  phrase,  to  satisfy  their  preferences  and  let  the  axioms 
satisfy  themselves.  Still  others  (H.  ftaiffa)  tend,  intuitively,  to 
violate  the  axioms  but  feel  guilty  shout  it  and  go  back  into  further 
analysis. 

The  Important  finding  is  that,  after  re-thinking  all  their  "offending" 
decisions  in  the  light  of  the  axioms,  a  number  of  people  who  are  not  only 
sophisticated  but  reasonable  decide  that  they  wish  to  persist  in  their 
choices.  This  includes  people  who  previously  felt  a  "first-order 
commitment"  to  the  axioms,  many  of  them  surprised  end  some  dismayed  to 
find  that  they  wished,  in  these  situations,  to  violate  the  3ure- thing 
Principle.  Since  this  group  included  L.  J.  Savage,  when  last  tested  by 
xne  (I  have  been  reluctant  to  try  him  again),  it  seems  to  deserve  respect¬ 


ful  consideration. 
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HI.  WE t  ARE  SOME  UHCERPAUfTIES  WOT  RISKS? 

Individuals  who  would  choose  I  over  II  and  IV  over  III  In  the  example t 
above  (or,  II  over  I  and  III  over  IV )  are  a  Imply  not  acting  "as  though" 
they  assigned  numerical  or  even  qualitative  probabilities  to  the  events  in 
question.  There  are.  It  turns  out,  other  ways  for  them  to  act.  But  what 
are  they  doing? 

Even  with  so  few  observations.  It  Is  possible  to  say  some  other 
tilings  they  are  not  doing.  They  are  not  "mini maxing";  nor  are  they  applying 
a  "Burwlcz"  criterion,"  maximizing  a  weighted  average  of  minimum  payoff 
and  maximum  for  each  strategy.  If  they  were  following  any  such  rules 
they  would  have  been  Indifferent  between  each  pair  of  gambles,  since  all 
have  Identical  minima  and  maxima.  Moreover,  they  are  not  "mlnlaaxlng 
regret,"  since  In  terns  of  "regrets"  the  pairs  I-II  and  III-TV  are 
Identical.1 

Thus,  none  of  the  fhmlllar  criteria  tor  predicting  or  prescribing 
decisionmaking  under  uncertainty  corresponds  to  this  pattern  of  choices. 

Yet  the  choices  thmneelves  do  not  nppaar  to  be  careless  or  random.  They 
are  persistant,  reportedly  deliberate,  and  they  seem  to  predominate 
empirically;  many  of  the  people  who  take  them  era  anlnently 
reasonable,  and  they  Insist  that  they  want  to  behave  this  way,  even  though 
they  cay  be  generally  respectful  of  tbs  Savage  axioms.  There  are  strong 
Indications,  in  other  words,  not  mtrely  of  the  existence  of  reliable 
patterns  of  blind  behavior  but  of  the  operation  of  definite  normative 
criteria,  different  from  and  conflicting  with  the  familiar  opes,  to  which 
these  people  are  trying  to  conform.  If  we  are  talking  about  you,  among 
others,  we  might  call  on  your  Introspection  once  a^in.  What  did  you 
think  you  were  doing?  What  were  you  trying  to  do? 
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One  thing  to  be  explained  is  the  fact  that  you  probably  would  not 
violate  the  axioms  in  certain  other  situations.  In  the  urn  example, 
although  a  person's  choices  may  not  allow  us  to  infer  a  probability  for 
Yellow,  or  for  (Red  or  Black),  we  may  be  able  to  deduce  quite  definitely 
that  he  regards  (Yellow  or  Black)  as  "no re  likely  than"  Red;  in  fact,  we 
might  be  able  to  arrive  at  quite  precise  numerical  estimates  for  his 
probabilities,  approximating  2/3,  1/3.  What  is  the  difference  between 
these  uncertainties,  that  laade  to  such  different  behavior? 

Responses  from  confessed  violators  indicate  that  the  difference  is 
not  to  be  found  in  terms  of  the  two  factors  counonly  used  to  determine  a 
choice  situation,  the  relative  desirability  of  the  possible  payoffs  and 
the  relative  likelihood  of  the  events  affecting  them,  but.  in  a  third 
dimension  of  the  problem  of  choice:  the  nature  of  one's  information 
^  concerning  the  relative  likelihood  of  events.  What  is  at  Issue  might  be 
called  the  ambiguity  of  this  information,  a  quality  depending  on  the 
amount,  type,  reliability  and  "unanimity"  of  information,  and  giving 
rise  to  one's  degree  of  "oonfldence"  in  an  estimate  of  relative  likelihoods. 

fluofa  rules  as  alnlmsxlnc,  animating,  Hurwlc*  criteria  or  mlnlmaxlng 
regret  are  usually  prescribed  for  situations  of  "complete  ignorance," 

In  which  a  decisionmaker  lacks  any  information  whatever  on  relative 
likelihoods.  Ibis  would  be  a  case  in  our  urn  example  if  a  subject  had  no 
basis  for  considering  sny  of  the  possible  probability  distributions  over 
Red,  Yellow,  Black  —  such  as  (1,6,0),  (0,1,0),  (0,0,1)  —  as  a  better 
estimates,  or  basis  for  decision,  than  any  other.  On  the  other  hand,  the 
Savage  axioms,  and  the  general  "Bayesian"  approach,  are  unquestionably 
appropriate  when  a  subject  is  willing  to  base  his  decisions  on  a  definite 
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and  precise  choice  of  a  particular  distribution:  his  uncertainty  In  such 
a  situation  is  unequivocally  In  the  form  of  "risk." 

But  the  state  of  information  in  our  urn  example  can  be  characterised 
neither  as  "ignorance"  nor  "risk"  in  these  senses.  Each  subject  does 
know  enough  about  the  problem  to  rule  out  a  nunber  of  possible  distribu¬ 
tions,  including  all  three  mentioned  shove.  He  knows  (by  the  terms  of 
the  experiment)  that  there  are  Red  balls  in  the  urn;  in  fact,  he  knows 
that  exactly  l/3  of  the  balls  are  Red.  Thus,  in  his  "choice"  of  a  sub¬ 
jective  probability  distribution  over  Red,  Yellow,  Black  —  if  he  wanted 
such  an  estimate  as  a  basis  for  decision  —  he  is  limited  to  the  set  of 
potential  distributions  between  (l/3,  2 /},  0)  and  (l/3»  0,  2/3):  i.e.,  to 
the  infinite  set  (l/3,\,  2/3-k),  0  <X<  2/3  •  lacking  any  observations 
on  the  number  of  Yellow  or  Black  balls,  be  may  have  little  or  no  information 
indicating  that  one  of  the  remaining,  infinite  set  of  distributions  is 
no  re  "likely,"  more  worthy  of  attention  than  any  other.  If  iie  should 
accumulate  some  observations,  in  the  form  of  nail  sample  distributions, 
this  set  of  "reasonable"  distributions  would  diminish,  and  a  particular 
distribution  mi#it  gather  increasing  strength  as  a  candidate;  but  so  long 
as  the  samples  main  nail,  he  may  be  far  fra  able  to  select  one  from  a 
number  of  distributions  as  a  unique  basis  for  decision. 

In  some  situations  where  two  or  mors  probability  distributions  over 
the  states  of  nature  seem  reasonable,  or  possible,  it  may  still  be 
possible  to  draw  on  different  sorts  of  evidence,  establishing  probability 
weights  in  turn  to  these  different  distributions  to  arrive  at  a  final, 
composite  distribution.  Even  in  our  examples,  it  would  be  misleading  to 
place  much  emphasis  on  the  notion  that  a  subject  has  no  information  about 
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the  contents  of  an  urn  on  which  no  observations  have  been  asde.  The  subje 
can  always  ask  hi  itself:  "What  Is  the  likelihood,  that  the  experimenter  ha n 
rigged  this  urn?  Assuming  that  he  has,  what  proportion  of  Red  balls  did 
be  probably  set?  If  he  is  trying  to  trick  me,  hov  Is  he  going  about  It? 
What  other  bets  Is  he  going  to  oxter  me?  What  sort  of  results  is  he  afte.' 
If  he  has  had  a  lot  of  experience  with  psychological  tests  before,  he  may 
be  able  to  bring  to  bear  a  good  deal  of  information  and  intuition  that 
seams  relevant  to  the  problem  of  weighting  the  different  hypotheses,  the 
alternative  reasonable  probability  distributions.  In  the  end,  these 
weights,  and  the  resulting  composite  probabilities,  may  or  may  not  be 
equal  for  the  different  possibilities.  In  our  examples,  actual  subjects 
do  tend  to  be  indifferent  between  batting  on  Red  or  Black  In  the 
unobserved  urn,  in  the  first  case,  or  between  betting  on  Yellow  or  Black 
In  the  second.  This  need  not  at  all  mean  that  they  felt  "completely 
Ignorant"  or  that  they  oould  think  of  no  reason  to  favor  one  or  the  other; 
it  does  Indicate  that  the  reasons,  If  may,  to  favor  one  or  the  other 
balanced  out  objectively  so  that  the  possibilities  entered  Into  their 
final  decisions  weighted  equivalently. 

let  us  assume,  for  purposes  of  discussion,  that  an  Individual  can 
always  assign  relative  weights  to  alternative  probability  distributions 
reflecting  the  relative  support  given  by  his  information,  experience  and 
Intuition  to  these  rival  hypotheses.  This  implies  that  he  can  always  assit 
relative  likelihoods  to  the  states  of  nature.  But  hov  does  he  act  in  the 
presence  of  his  uncertainty?  The  answer  to  that  may  depend  on  another 
sort  of  Judgaent,  shout  the  reliability,  credibility,  or  adequacy  of  his 
information  (including  his  relevant  experience,  advice  and  Intuition)  as  a 
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whole:  not  about  the  relative  support  it  may  give  to  one  hypo the see  as 
opposed  to  another,  but  about  its  ability  to  lend  support  to  any  hypothesis 
at  all. 

If  all  the  information  about  the  events  in  a  set  of  gambles  were  In 

the  form  of  sample  •distributions,  then  ambiguity  might  be  closely  related, 
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inversely,  to  the  size  of  the  sample.  But  sample -size  is  not  a  universally 
useful  index  of  this  factor.  Information  about  many  events  cannot  be 
conveniently  described  in  terms  of  a  sample  distribution;  moreover,  sample* 
size  seems  to  focus  mainly  on  the  quantity  of  information.  "Ambiguity"  may 
be  high  (and  the  confidence  In  any  particular  estimate  of  probabilities  low) 
even  where  there  is  ample  quantity  of  Information,  when  there  are  questions 
of  reliability  and  relevance  of  Information,  and  particularly  where  there 
is  conflicting  opinion  and  evidence. 

This  Judgaant  of  the  aablgulty  of  one' a  Information,  of  the  over-all 
credibility  of  one' a  ccmpoalte  estimates,  of  one's  confidence  In  them, 
cannot  be  expressed  In  terms  of  relative  likelihoods  or  events  (if  It 
could.  It  would  simply  affect  the  final,  compound  probabilities) .  Any 
scrap  of  evidence  bearing  on  relative  likelihood  should  already  be 
represented  In  those  estimates.  But  having  exploited  knowledge,  guess, 
moor,  assumption,  advice,  to  arrive  at  a  final  Judgaent  that  one  event  la 
more  likely  than  another  or  that  they  are  equally  likely,  one  can  still 
stand  back  from  this  process  and  ask:  "How  ouch,  In  the  end,  is  all  this 
worth?  Bov  much  do  I  really  know  about  the  problem?  How  firm  a  basis  for 
choice,  for  appropriate  decision  and  action,  do  I  have?"  The  answer,  "I 
don't  know  very  much,  end  I  can't  rely  on  that,"  may  sound  rather  familiar, 
even  In  connection  with  markedly  unequal  estimates  of  relative  likelihood. 
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If  "complete  Ignorance"  is  rare  or  non -exiB tent,  "considerable" 
Ignorance  is  surely  not. 

Savage  himself  alludes  to  this  sort  of  Judgment  and  notes  as  a 
difficulty  vith  his  approach  that  no  recognition  is  given  to  it: 


...there  seem  to  be  some  probability  relations  about  which  we 
feel  relatively  "sure"  as  compared  with  others... The  notion  of 
"sure"  and  "unsure"  introduced  here  is  vague,  and  my  complaint 
is  precisely  that  neither  the  theory  of  personal  probability, 
as  it  is  developed  in  this  book,  nor  any  other  device  known  to 
me  renders  the  notion  less  vague... A  second  difficulty,  perhaps 
closely  associated  with  the  first  one,  stems  from  the  vagueness 
associated  with  Judgments  of  the  magnitude  of  personal 
probability.  16 


Knight  asserts  what  Savage's  approach  tacitly  denies,  that  such  over- 

* 

all  Judgments  may  influence  decision: 


The  action  which  follows  upon  an  opinion  depends  as  much  upon 
the  amount  of  confidence  in  that  opinion  as  it  does  upon  the 
favorableness  of  the  opinion  itself .. .Fidelity  to  the  actual 
psychology  of  the  situation  requires,  we  must  insist,  recog¬ 
nition  of  these  two  separate  exercises  of  judgnent,  the 
formation  of  an  estimate  and  the  estimation  of  its  value.1? 


Let  us  imagine  a  situation  in  which  so  many  of  the  probability  judgment 
an  individual  can  bring  to  bear  upon  a  particular  problem  are  either 
"vague"  or  "unsure"  that  his  confidence  in  a  particular  assignment  of 
probabilities,  as  opposed  to  sane  other  of  a  set  of  "reasonable”  distribu¬ 
tions,  is  very  low.  We  may  define  thiB  as  a  situation  of  high  ambiguity. 

The  general  proposition  to  be  explored  below  is  th.it  ic  is  precisely  in 
situations  of  this  sort  that  self-consistent  behavior  violating  the  Savage 
axioms  may  commonly  occur. 

Ambiguity  is  a  subjective  variable,  but  it  should  be  possible  to 

if entity  "objectively"  some  situations  likely  to  present  high  ambiguity, 

i 

by  noting  situations  where  available  information  is  scanty  or  obviously 

unreliable  or  iiighly  conflicting;  or  where  expressed  expectations  ol' 
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different  individual*  differ  widely;  or  where  expressed  confidence  in 
estimates  tend*  to  be  low.  Thus,  as  compared  with  the  effects  of  fatal  liar 
production  decisions  or  we  11 -known  random  processes  (like  coin  flipping  or 
roulette) ,  the  results  of  Research  and  Development,  or  the  performance  of 
a  new  President,  or  the  tactics  of  an  unfamiliar  opponent  are  all  likely 
to  appear  ambiguous.  This  would  suggest  a  broad  field  of  application  for 
the  proposition  above. 

In  terns  of  Shackle's  cricket  example:  Imagine  an  American  observer 
who  had  never  heard  of  cricket,  knew  none  of  the  rules  or  the  method  of 
scoring,  and  had  no  clue  a a  to  the  past  record  or  present  prospects  of 
England  or  Australia.  If  he  were  confronted  with  a  set  of  side  bets  as  to 
whether  England  would  bat  first— thia  to  depend  on  the  throw  of  a  die  or  a 
coin— I  expect  (unlike  Shackle)  that  he  would  be  found  to  obey  Savage's 
axioms  pretty  closely,  or  at  least,  to  want  to  obey  then  if  any  discrepancies 
were  pointed  out.  Yet  Z  should  not  be  surprised  by  quite  different 
behavior,  at  odds  with  the  axicas,  if  that  particular  observer  were  forced 
to  gaable  heavily  on  the  proposition  that  ttigland  would  win  the  natch. 

Let  us  sqppote  that  an  individual  aunt  choose  aaoag  a  certain  set  of 
actions,  to  whose  possible  consequences  we  can  assign  "von  Neumann - 
Morgen stem  utilities"  (reflecting  the  fact  that  in  choosing  naong  some  set 
of  "unambiguous"  gables  involving  other  events  and  these  sane  outcomes, 
he  obeys  the  Savage  axioms).  Ve  shall  suppose  that  by  compounding  various 
probability  Judgaents  of  varying  degrees  of  reliability  he  can  eliminate 
certain  probability  distributions  ovrr  the  states  of  nature  as  "unreasonable, " 
assign  weights  to  others  and  arrive  at  a  composite  "estimated"  distribution 
y°  that  represents  all  his  available  Information  on  relative  likelihoods. 
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But  .tot  us  further  suppose  that  the  situation  Is  mablguous  for  his..  Out  of 
the  set  Y  of  all  possible  distributions  there  mains  a  set  Y°  of  JUstrlbu- 
tions  that  still  seem  "reasonable/1  reflecting  Judgments  that  he  "mi/at 
almost  as  veil"  have  made,  or  that  his  Information— perceive  .1  as  cc-eity, 
unreliable,  msblguoua— does  not  permit  him  confidently  to  rule  cut. 

In  choosing  between  tvo  actions,  I  end  II,  he  can  compute  their 
expected  utilities  in  terms  of  their  payoffs  and  the  "estimated"  probability 
distribution  y°.  If  the  likelihoods  of  the  events  In  question  were  as 
unambiguous  as  those  In  the  situations  In  which  his  von  Hemann  -Morgen  a  tern 
utilities  vexe  originally  measured,  this  would  be  the  end  of  the  matter; 
these  payoffs  embody  all  his  attitudes  toward  "risk,"  and  expected  values 
will  correspond  to  his  actual  prefsrenoes  among  "risky"  gambles.  But  in 
this  case,  where  his  final  assignment  of  probabilities  is  less  confident, 
that  calculation  may  leave  him  uneasy.  'Bo  I  has  a  lower  expectation 
then  H,  on  the  basis  of  thaw  estimates  of  probabilities, "  he  may  reflect ; 
"Bow  much  does  that  tall  me?  That's  not  much  of  a  reason  to  choose  II." 

In  this  state  of  mind,  searching  for  additional  grounds  for  choice, 
ha  may  try  new  criteria,  aak  new  questions.  For  any  of  the  probability 
distributions  In  the  "reasonably  possible"  set  Y°,  he  can  ooqpute  an 
expected  value  for  each  of  his  actions.  It  might  now  occur  to  him  to  ask: 
"What  might  happen  to  as  If  ay  best  estimates  of  likelihood  don't  apply? 

What  la  the  worst  of  the  reasonable  expectations  of  payoff  that  I  might 
associate  with  action  I?  With  action  II?"  Be  might  find  that  he  could 
answer  this  question  about  the  lower  limit  of  the  reasonable  expectations 
for  a  given  action  much  more  confidently  than  he  oould  arrive  at  s  single, 
"best  guess"  expectation;  the  latter  estimate,  he  might  suspect,  might  vary 


almost  hourly  with  his  mood,  whereas  tbs  former  might  look  much  more  solid, 
almost  a  "fact, "  a  piece  of  evidence  definitely  worth  considering  in  making 
his  choice.  In  almost  no  cases  (excluding  "complete  ignorance"  as 
unrealistic)  will  the  only  fact  worth  noting  shout  a  prospective  action 
he  Its  "security  level":  the  "worst"  of  the  expectations  associated  with 
reasonably  possible  probability  distributions.  To  choose  on  a  "maxlmin" 
criterion  alone  would  be  to  ignore  entirely  those  probability  judgments 
for  which  there  is  evidence.  But  In  situations  of  high  ambiguity,  such  a 
criterion  may  appeal  to  a  conservative  person  as  deserving  some  weight, 
when  interrogation  of  his  own  subjective  estimates  of  likelihood  has 
failed  to  disclose  a  set  of  estimates  that  compel  exclusive  attention  in 
his  decision-making. 

If,  in  the  end,  such  a  person  chooses  action  I,  he  may  explain: 

"In  terns  of  ay  best  estimates  of  probabilities,  action  I  has 
almost  as  high  an  expectation  os  action  II.  But  if  my  best 
guesses  tould  be  rotten,  which  wouldn't  surprise  ms,  action 
I  gives  me  better  protection;  the  worst  expectation  that  looks 
reasonably  possible  lan't  much  worse  than  the  "best  guess" 
expectation,  whereas  with  action  ZZ  It  looks  possible  that 
ny  expectation  could  really  be  terrible." 

An  advocate  of  the  Savage  sartms  as  normative  criteria,  foreseeing 

where  such  reasoning  will  lead,  soy  interject  In  exasperation: 

"Why  are  you  double -counting  the  "worst"  possibilities?  They're 
already  taken  Into  account  in  your  over-all  estimates  of  likelihoods, 
weighted  in  a  reasoned,  realistic  way  that  represents— by  your  own 
claim— your  best  Judgment.  Once  you've  arrived  at  a  probability 
distribution  that  reflects  everything  you  know  that's  relevant, 
don’t  fiddle  around  with  it,  use  it.  Stop  asking  irrelevant 
questions  and  whining  about  how  little  you  really  know.” 

But  this  msy  evoke  the  calm  reply: 

"It's  no  use  bullying  me  Into  taking  action  XI  by  flattering  my 
'best  judgaent.'  I  know  how  little  that's  based  on;  I'd  back  It 
If  we  were  betting  with  pennies,  hut  Z  want  to  know  boom  other 
things  If  the  stakes  arc  important,  and  'How  much  night  I  expect 
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to  lose,  without  being  unreasonable?'  Just  strikes  me  as  one  of 
those  things.  As  for  the  reasonableness  of  giving  extra  weight 
to  the  "bad"  likelihoods,  my  teat  for  that  is  pragnatlc ;  in 
situations  where  I  really  car. 't  Judge  confidently  among  a  whole 
range  of  possible  distributions,  this  rule  steers  me  toward  actions 
whose  expected  values  are  relatively  insensitive  to  the  particular 
distribution  in  that  range,  without  giving  up  too  much  in  terns  of 
the  "best  guess"  distribution.  That  strikes  me  as  a  sensible, 
conservative  rule  to  follow.  What’s  vronf  vita  it? 

"What's  wrong  with  It"  is  that  it  will  lead  to  violations  of  Savage's 

Postulate  2,  and  will  make  it  impossible  for  an  observer  to  describe  the 

subject's  choices  as  though  he  were  maximizing  a  linear  combination  of 

payoffs  and  probabilities  over  events.  Neither  of  these  considerations, 

even  on  reflection,  may  pose  to  our  conservative  subject  overwhelming 

imperatives  to  change  hi 3  behavior.  It  will  not  be  true  that  this  beiiavior 

is  erratic  or  unpredictable  (we  shall  formalize  it  in  terms  of  a  decision 

rule  below),  or  exhibits  intransitivities,  or  amounts  to  "throwing  away 

utility"  (as  would  be  true,  for  exsnple,  if  it  led  Ida  occasional!;,'  to 

choose  strategies  that  were  strongly  "dominated"  by  others) .  There  is,  b. 

fact,  no  obvious  basis  for  asserting  that  it  will  lead  him  in  the  long  run 

to  worse  outcomes  than  he  could  aspect  if  he  reversed  some  of  hi**  preference 

to  conform  to  the  Savage  axioms. 

Another  person,  or  this  same  person  in  a  different  situation,  night 
liavc  turned  instead  or  in  addition  to  some  other  criteria  for  guidance . 

One  night  ask,  in  an  ambiguous  situation;  "What  is  the  best  expectation  I 
night  associate  with  this  action,  without  being  unreasonable?"  Or:  "What 
is  ito  average  expectation,  giving  all  the  reasonably  possible  distributions 
'qual  weight?"  The  latter  consideration  would  not,  as  it  happens,  lead  to 
behevior  violating  the  Savage  axioms.  The  form ut  would,  in  the  same  fashion 
though  in  uie  opposite  direction  as  the  "mtL' l run"  criterion  discussed  above; 
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indeed,  this  "maxi maxing"  consideration  could  generate  the  minority  behavior 
of  those  who,  in  our  urn  example,  prefer  II  to  I  and  III  to  IV.  Both  these 
patterns  of  behavior  could  be  described  by  a  decision  rule  similar  to  the 
one  below,  and  their  respective  rationales  might  be  similar  to  that  given 
above.  But  let  us  continue  to  focus  on  the  particular  pattern  discussed 
above,  because  it  seems  to  predominate  empirically  (at  least,  with  respect 
to  our  examples)  and  because  it  most  frequently  corresponds  to  advice  to 
be  found  on  decision -making  in  ambiguous  situations. 

In  reaching  his  decision,  the  relative  weight  that  a  conservative 

person  will  give  to  the  question,  "What  is  the  worst  expectation  that  might 

appear  reasonable?"  will  depend  on  his  confidence  In  the  judgments  that  no 

into  his  estimated  probability  distribution.  The  less  confident  he  is, 

the  more  he  will  sacrifice  In  terns  of  estimated  expected  payoff  to  achieve 

a  given  increase  in  'security  level";  the  more  confidant,  the  greater 

Increase  in  "security  1  vel"  he  would  demand  to  compensate  for  a  given  drop 

in  estimated  expectation.  This  Implies  that  "trades"  are  possible  between 

security  level  end  estimates  '■"pectation  In  his  preferences,  and  that  does 

seem  to  correspond  to  observed  reason ses.  Many  subjects  will  still  prefer 

to  bot  on  Rjj  than  Rj  In  our  first  eacaapie  even  whan  the  proportion  of  Red 

to  Black  in  Um  II  is  lowered  to  49: 51 1  or  will  prefer  to  bet  on  Red  tlian 

on  Yellow  in  the  second  exaaple  even  when  one  Red  ball  is  removed  from  the 

um.  But  at  some  point,  as  the  "unambiguous"  likelihood  beoomes 

13 

increasingly  unfavorable,  their  choices  will  switch. 

Asevming,  purely  for  simplicity,  that  these  factors  enter  into  his 
decision  rulr  in  linear  combination,  ws  can  danota  by  yG  his  degree  of 
confidence.  In  a  given  state  of  info matioj^ ambiguity,  in  the  estimated 
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distribution  y°,  which  in  turn  reflects  all  of  his  Judgnents  on  the 
relative  likelihood  of  distributions,  including  Jud(joants  of  equal  likeli¬ 
hood.  Let  min^  be  the  minimum  ejected  payoff  to  an  act  x  as  the  probability 
distribution  ranges  over  the  set  Y°;  let  eat  be  the  expected  payoff  to  the 
act  x  corresponding  to  the  estimated  distribution  y°. 

The  simplest  decision  rule  reflecting  the  above  considerations  would 
19 

be:  Associate  with  each  x  the  index: 


*est  +  (1-/0)*  min 
x  x 

Choose  that  act  with  the  highest  index. 

An  equivalent  formulation  would  be  the  following,  where  y°  is  the 
estimated  probability  vector,  y^"n  the  probability  vector  in  Y°  correspondl: 
to  action  x:  Aaaociate  vith  each  x  the  index: 

[  /':■  .y°  ♦  (l-^o)  ^  J(x) 

Chooae  that  act  with  the  highest  Index. 

In  the  case  of  the  Bed,  Yellow  and  Black  balls,  supposing  no  samples 
and  no  explicit  information  except  that  l/3  of  the  balls  are  Red,  many 
subjects  might  lean  toward  an  estimated  distribution  of  (1/3,  l/3»  l/3) • 
if  not  from  "ignorance,"  then  from  counterbalancing  considerations.  But 
many  of  these  would  find  the  situation  ambiguous;  for  them  the  "reasonable" 
distributions  Y°  might  be  all  those  between  (l/3,  2/3,  0)  and  (l/3,  0,  2/3). 
Assuming  for  purposes  of  illustration  l/4  (Y°,  y°,  X  arid  are  all 
subjective  data  to  be  inferred  by  an  observer  or  supplied  by  the  individual, 
depending  on  whether  the  criterion  is  being  used  descriptively  or  for 
convenient  decision -making) ,  the  formula  for  the  index  would  be: 


1 

4 


eat 


♦ 


2 

4 


min  . 
x 
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The  relevant  data  (assigning  arbitrary  utility  values  of  6  and  0  to  the 
money  outcomes  $100  and  $0)  would  be: 


Red  Yellow  Black  Min  Est  Index 

x  x 

I 

II 

III 

IV 

A  person  conforming  to  this  rule  with  these  values  would  prefer  I  to  II 

and  IV  to  III,  in  violation  of  the  Sure -thing  Principle:  as  do  most  people 

queried.  In  justifying  this  pattern  of  behavior  he  might  reproduce  the 

rationale  quoted  above  (g.v.)j  but  moat  verbal  explanations,  somewhat  less 

articulately,  tend  to  be  along  these  lines: 

The  expected  payoff  for  action  I  is  definite:  2.  The  risks  under 
action  II  may  be  no  greater,  but  I  know  what  the  risk  la  under  action 
I  and  I  don't  under  action  n.  The  expectation  for  action  II  is 
ambiguous.  It  might  be  better  or  It  might  be  worse,  anything  from 
0  to  4.  TO  be  on  the  safe  aids.  I'll  assume  that  It's  closer  to 
0;  so  action  I  looks  batter.  Ry  the  same  token,  IV  looks  better 
than  HI;  I  know  that  ay  expected  p^off  with  IV  is  4,  whereas 
with  III  It  might  be  as  low  as  2  (which  Isn't  compensated  by  the 
chance  that  It  could  be  6). 

Leaving  the  sdvocate  of  the  Ravage  axioms,  If  he  is  still  around  to 
hear  this,  to  renew  his  ooqplalnts  about  the  silliness  and  Irrelevance  of 
such  considerations,  1st  us  note  a  practical  consequence  of  the  decision 
rule  which  the  above  comment  brings  Into  focus.  It  has  already  been 
mentioned  that  the  rule  will  favor— other  things  (such  as  the  estimated 
expectation)  being  roughly  equal— actions  whose  expected  value  is  less 
sensitive  to  variation  of  the  probability  distribution  within  the  range 
of  ambiguity.  Such  actions  may  frequently  be  those  definable  as  "status 
quo"  or  "present  behavior"  strategies. 
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0 
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2  2 
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A  familiar,  ongoing  pattern  of  activity  may  be  subject  to  considerable 
uncertainty,  but  this  uncertainty  is  more  apt  to  appear  in  the  form  of 
"risk";  the  relation  between  given  states  of  nature  is  known  precisely,  and 
although  the  random  variation  in  the  state  of  nature  which  "obtains"  may  be 
considerable,  its  stochastic  properties  are  often  known  confidently  and  in 
detail.  (Actually,  this  confidence  may  be  self -deceptive,  based  on  ignoring 
some  treacherous  possibilities;  nevertheless,  it  commonly  exists) .  In 
contrast,  the  ambiguities  surrounding  the  outcome  of  a  proposed  Innovation, 
a  departure  from  current  strategy,  may  be  much  more  noticeable.  Different 
sorts  of  events  are  relevant  to  its  outcome,  and  their  likelihoods  must  now 
be  estimated,  often  with  little  evidence  or  prior  expertise;  and  the  effect 
of  a  given  state  of  nature  upon  the  outcome  of  the  new  action  may  itself  be 
In  question.  Its  variance  may  not  «pear  any  higher  than  that  of  the 
faniliar  action  when  computed  on  the  basis  of  "best  estimates"  of  the 
probabilities  involved,  yet  the  meanlngfulness  of  this  calculation  may  be 
subject  to  doubt.  The  decision  rule  discussed  will  not  preclude  choosing 
such  an  act,  but  it  will  definitely  bias  the  choice  away  from  such  ambiguous 
ventures  and  toward  the  strategy  with  "known  risks."  Thus  the  rule  is 
"conservative"  In  a  sense  more  familiar  to  everyday  conversation  tiian  to 
statistical  decision  theory;  it  may  often  favor  traditional  or  current 
strategies,  even  perhaps  at  high  risk,  over  innovations  whose  consequences 
are  undeniably  ambiguous.  This  property  may  recommend  It  to  some,  discredit 
It  with  others  (some  of  whom  might  prefer  to  reverse  the  rule,  to  emphasize 
the  more  hopeful  possibilities  In  ambiguous  situations);  it  does  not  seem 
irrelevant  to  one's  attitude  toward  the  behavior. 

In  the  equivalent  formulation  in  terms  of  y^11  and  y°,  the  subject 
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above  could  be  described  "as  though"  he  were  assigning  weights  to  the 
respective  payoffs  of  actions  II  and  IH,  whose  expected,  values  are 
ambiguous,  as  follows  (assming  y°  -  (l/j,  1/3,  1/3)  in  each  case): 


II 

III 

Although  the  fined  set  of  weights  for  each  set  of  payoffs  resemble  proba¬ 
bilities  (they  are  positive,  sua  to  unity,  and  represent  a  linear  combina¬ 
tion  of  two  probability  distributions),  they  differ  fbr  each  action,  since 
will  depend  on  the  payoffs  for  x  and  will  vary  fbr  different  actions. 
If  these  weights  were  Interpreted  as  "probabilities, "  we  would  have  to 
regard  the  subject's  subjective  probabilities  as  being  dependant  upon  his 
payoffs,  his  evaluation  of  the  outcome.  Thus,  this  model  would  be 
appropriate  to  represent  cams  of  true  pessimism,  or  optlmlsm/vlshfulness 
(with  y^**  substituting  fbr  •  However,  in  this  cam  we  are  assisting 
conservatism,  not  pessimism;  our  subject  does  not  actually  expect  the 
worst,  but  be  chooses  to  set  "as  though"  the  worst  were  somewhat  more 
likely  than  his  bee*  sstjflgSgi  SL  llbsllhood  would  indicate.  In  either 
cam,  be  violates  the  8avag*  axiom;  it  is  Impossible  to  infer  from  the 
resulting  behavior  a  set  of  probabilities  tor  events  independent  of  his 
payoffs.  In  effect,  be  "distorts"  his  best  estimates  of  likelihood,  in 
the  direction  of  Increased  emphasis  on  the  less  favorable  outcomes  and  to 
a  degree  depending  on/0,  his  confidence  in  his  best  estimate. 

Hot  only  does  this  decision  model  account  fbr  "deviant"  behavior  in  a 
particular,  anbiguous  situation,  but  it  covers  the  observed  shift  in  a 


/°'Y°  +  (1-/0)  y^ 
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subject's  behavior  as  ambiguity  decreases .  Suppose  that  a  sample  Is 
drawn  from  the  urn,  strengthening  the  confidence  In  the  best  estimates  of 
likelihood,  so  that  /°  Increases,  say,  to  3/4.  The  weights  for  the  peyoffs 
to  actions  II  and.  HI  would  now  be: 

*>•  jr°  *  (!-/>)  yf° 

n  (  y.  |»  ) 

ra  <  V  if  I  > 

and  the  over-all  index  would  be: 

Index 

I  2 

n  1.5 

III  3-5 

IV  4 

In  other  word s,  the  relative  Influence  of  the  consideration,  "What  Is  the 
worst  to  be  expected?"  upon  the  comparison  of  actions  is  lessened.  The 
final  walgxts  approach  closer  to  the  "best  estimate"  values,  and  I  and  II 
approach  closer  to  Indifference,  as  do  HI  and  IV.  This  latter  aspect 
might  show  ig>  behavloraUy  In  the  Mount  a  subject  is  willing  to  pay  for  a 
given  bet  on  Yellow,  or  on  (Red  or  Black),  In  the  two  situations. 

In  the  limit,  as  —blgulty  diminishes  for  one  reason  or  another  and 
/°  approaches  1,  the  estimated  distribution  will  coos  Increasingly  to 
dominate  decision.  With  confidence  in  the  best  estimates  high,  behavior  on 
the  basis  of  the  proposed  decision  rule  will  roughly  conform  to  the  Savage 
axioms,  and  It  would  be  possible  to  Infer  the  estimated  probabilities  from 
observed  choices.  But  prior  to  this,  a  large  number  of  Information  states, 
distinguishable  from  each  other  and  all  far  removed  from  "complete 
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ignorance,"  might  all  he  sufficiently  mabiguous  as  to  lead  many  decision- 
makers  to  conform  to  the  above  decision  rule  with  /°<  1,  in  clear 
violation  of  the  axieofc. 

Are  they  foolish?  It  Is  not  the  Object  of  this  paper  to  Judge  that. 

I  have  been  concerned  rather  to  advance  the  testable  propositions:  (l) 
certain  information  states  can  be  meaningfully  identified  as  highly 
ambiguous;  (2)  in  these  states,  many  reasonable  people  tend  to  violate  the 
Savage  axioms  with  respect  to  certain  choices;  (3)  their  behavior  is 
deliberate  and  not  readily  reversed  upon  reflection;  (4)  certain  patterns 
of  "violating"  behavior  can  be  distinguished  and  described  in  terns  of  a 
specified  decision  rule. 

If  these  propositions  should  prove  valid.,  the  question  of  the 
optimality  of  this  behavior  would  gain  more  interest.  The  mere  fact  that 
it  conflicts  with  certain  axioms  of  choice  that  at  first  glance  appear 
reasonable  does  not  seam  to  me  to  foreclose  this  question;  empirical 
research,  and  even  preliminary  speculation,  about  the  nature  of  actual  or 
"successful"  decision  •making  tnder  uncertainty  le  still  too  young  to  give 
us  oanffdsnos  that  these  axioms  are  not  abstract Ing  away  Aram  vital  consider 
at  ions.  It  would  seam  incautious  to  ruls  peremptorily  that  the  people  in 
question  should  not  allow  their  perception  of  ambiguity,  their  unease  with 
their  best  estimates  of  probability,  to  Influence  their  decision:  or  to 
assert  that  the  manner  In  which  they  respond  to  it  Is  against  their  long- 
run  interest  and  that  they  would  be  in  some  sense  better  off  If  they  should 
go  against  their  deep-felt  preferences.  If  their  rationale  for  their 
decision  behavior  is  not  vnlquely  compelling  (and  recent  discussions  with 
T .  Schelling  have  raised  questions  in  my  mind  about  it) ,  neither,  it  seems 


to  me,  are  the  counterarguments .  Indeed,  it  seems  out  of  the  question 
susaarily  to  judge  their  behavior  as  irrational:  I  am  included  among  there¬ 
in  any  case,  it  follows  from  the  propositions  above  that  for  their 
behavior  In  the  situations  in  question,  the  Bayesian  or  Savage  approach 
gives  wrong  predictions  and,  by  their  lights,  bad  advice.  They  act  In 
conflict  with  the  axioms  deliberately,  without  apology,  because  It  seems 
to  them  the  sensible  way  to  behave.  Are  they  clearly  mistaken? 


